Papers by Franco M. Luque
RoBERTuito: a pre-trained language model for social media text in Spanish (2022.lrec-1)
Copied to clipboard
| Challenge: | Pre-trained language models have been used in many natural language processing tasks . some domain-specific models have shown to improve performance in some domains . however, for languages other than English, such models are not widely available . |
| Approach: | They present a pre-trained language model for user-generated text in Spanish . it is based on 500 million tweets and has some cross-lingual abilities . |
| Outcome: | The model outperforms models trained on over 500 million tweets on a benchmark in spanish and english. |
Region under Discussion for visual dialog (2021.emnlp-main)
Copied to clipboard
| Challenge: | Visual Dialog is assumed to require the dialog history to generate correct responses during a dialog. |
| Approach: | They propose an interpretable representation that visually grounds dialog history by constraining the image’s spatial features according to a semantic representation inspired by Question under Discussion. |
| Outcome: | The proposed representation constrains the image’s spatial features according to a semantic representation of the history inspired by the information structure notion of Question under Discussion. |